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Cloud Computing 


eCloud computing is the 
delivery of hosting 
services that are provided 
to a client over the WHERE Tere Heck 
Internet. is му ЈАТА? 


- Enable large-scale services 
without up-front investment. 
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Clouds are Elastic 


eNIST Definition of Cloud Computing 


"Cloud computing is a model for enabling 
convenient, on-demand network access to a shared 
pool of configurable computing resources (e.g., 
networks, servers, storage, applications, and 
services) that can be rapidly provisioned and 
released with minimal management effort or service 
provider interaction." 


Supporting Technologies 


eEnormous computer data-centres containing 
commodity hardware. 


eVirtualization of computation, storage, and 
communication. 
- Turn hardware and networking into software! 


eAchieve economies of scale. 


- Reduce costs of electricity, bandwidth, hardware, software and 
use low-cost locations. 


- Lower-cost than provisioning own hardware. 


e Large-scale distributed systems services, such as 
NoSQL datastores, object stores, and distributed 
filesystems, have enabled developers to build scalable 
cloud computing applications. 


Cloud Computing Essentials 


eCloud computing is Utility Computing 
- Cloud services are controlled and monitored by the cloud 
provider through a pay-per-use business model. 


eAn ideal cloud computing platform is: 
- efficient in its use of resources 
- scalable 
- elastic 
- self-managing 
- highly available and accessible 
- inter-operable and portable 


Cloud Properties 


eResource efficiency: computing and network 
resources are pooled to provide services to multiple 
users. Resource allocation is dynamically adapted 
according to user demand. 


eElasticity: computing resources can be rapidly and 
elastically provisioned to scale up, and released to 
scale down based on consumer's demand. 


Cloud Properties 


eSelf- managing services: a consumer can provision 
cloud services, such as web applications, server 
time, processing, storage and network as needed 
and automatically without requiring human 
interaction with each service's provider 


e Accessible and highly available: cloud resources 
are available over the network anytime and 
anywhere and are accessed through standard 
mechanisms that promote use by different types of 
platform (e.g., mobile phones, laptops, and PDAs). 


Over or Under-Provisioning 
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Dynamic Provisioning 


eIn traditional computing model, two common 
problems : 
- Underestimate system utilization which result in under 
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Dynamic Provisioning 


eOverestimate system utilization which results in low 
utilization 


Capacity 


| Unused resources 


Resources 


Demand 


Time 


eHow do we solve this problem? 
- Dynamically provision resources 


Real world estimates 


eAverage server utilization is 5% to 20%. 

ePeak workload exceeds the average by factors of 2 
to 10. 

eUsers provision for the peak. 

ePeak loads may occur based on the time of day or 
based on other factors (e.g. photo sharing after the 
holidays, drop/add within two weeks of start of 
term, etc.) 


Public Clouds, Private Clouds 
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Deployment Model 


eThere are four primary cloud deployment models : 
- Public Cloud 
- Private Cloud 
- Community Cloud 
- Hybrid Cloud 


Public Clouds 


ePublic clouds are owned by cloud service providers 
who charge for the use of cloud resources. 
eBasic characteristics: 
- Homogeneous infrastructure, Common policies 
- Shared resources and multi-tenancy 
- Leased or rented infrastructure 
- Economies of scale 


eAWS/EC2 (Amazon) 
eAzure (Microsoft) 
eGoogle Cloud Platform. 
e Rackspace. 


Private Clouds 


eThe cloud infrastructure belongs to and is operated 
by only one organization. 
eBasic characteristics : 
- Heterogeneous infrastructure; Customized policies 
- Dedicated resources 
- In-house infrastructure; End-to-end control 
eExamples include: 
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Other types of Clouds 


eCommunity cloud 


- The cloud infrastructure is shared by several organizations 
and supports a specific community that has shared 
concerns (e.g., mission, security requirements, policy, and 
compliance considerations). 


eHybrid cloud 


- The cloud infrastructure is a composition of two or more 
clouds (private, community, or public) that remain unique 
entities but are bound together by standardized or 
proprietary technology that enables data and application 
portability. 


Іаа5, PaaS and SaaS 


eInfrastructure as a Service (laaS) 
ePlatform as a Service (PaaS) 
eSoftware as a Service (SaaS) 
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Value Visibility to End Users 
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Spectrum of Cloud Users 
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Network 
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Virtualization 


e Virtualization is the abstraction of logical resources 
away from underlying physical resources. 


eA hypervisor (or Virtual Machine Monitor (VMM)) 
virtualizes a platform’s operating system. 


- The hypervisor manages OS’ as virtual machines (VMs), 
enabling multiple OS’ to share the same physical hardware. 
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Traditional Stack Virtualized Stack 


Hypervisor’s Trap and Emulate Model 


«Тһе hypervisor's virtualization paradigm is trap and 
emulate : 
- Normal instructions of guest OS 
* run directly on processor in user mode. 
- System Calls 
* CPU will trap to interrupt handler vector of Hypervisor. 
: Hypervisor jump back into guest OS. 
- Hardware Interrupts 
* Hardware makes CPU trap to interrupt handler of Hypervisor. 
* Hypervisor jumps to corresponding interrupt handler of guest OS. 
- Privilege Instructions 


- Running privilege instructions in guest OS will be trapped to 
Hypervisor for instruction emulation. 


- After emulation, the Hypervisor jumps back to guest OS. 


Trap and Emulate Model (VMM=Hypervisor) 


System Call 


Privilege instruction 
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Interrupt handler vector 


Hardware Interrupt 


VM Context Switching 


eThe hypervisor context switches virtual machines: 
1. Timer Interrupt in running VM. 

Context switch to Hypervisor. 

Hypervisor saves state of running VM. 

Hypervisor determines next VM to execute. 

Hypervisor sets timer interrupt. 

Hypervisor restores state of next VM. 


Hypervisor sets the program counter to timer interrupt 
handler of next VM. 


8. Next VM active. 


"2215 аъ Ля» ГУ 


VM Context Switching 
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Hypervisor Models 


TYPE 1 
pare metal 


[https://en.wikipedia.org/wiki/Hypervisor | 


KVM (Kernel-based Virtual Machine) 


eVMWare and Xen are the best-known virtualization 
platforms. 


eKVM (Kernel-based Virtual Machine) is an open- 
source virtualization platform 
- Linux host OS 


- Run multiple virtual machines (Windows, MAC, etc) on your 
linux box 


- IO is virtualized using a device model in KVM 


- KVM requires a modified QEMU (open-source processor 
emulator) for its IO virtualization framework. 


- Type 1 Hypervisor, as it is a kernel-level module. 


Virtualization using KVM in Linux 


eKVM is a loadable kernel module 
- kvm.ko 
* provides the core virtualization infrastructure 
- kvm-intel.ko / kvm-amd.ko 
* processor specific modules 


KVM + QEMU Virtualization 
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KVM Hypervisor 


Hosted OS (Linux) 


Physical Hardware 


Virtual Machines are software - APIs to drive them. 


OpenStack Compute REST API Features 


eAuthentication 


e Images 
eServers - List Images 
- List Servers IPs - Create Image/Snapshot 
- Create Server - Get Image Details 


- Delete Server ч с, | 
e Backup Schedules 
Reboot Server | - List Backup Schedules 
eFlavors (hardware config) - Create/Update 


- List Flavors - Disable 
- Get Flavor Details 


Platform-as-a-Service (PaaS) 
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TaaS is not Enough 


elaaS provides virtual machines, but it cannot provide 
elastic computing by itself, where services scale up 
and down to meet user demand. 
- Dynamic provisioning 


eExisting IaaS' do not provide support for the sharing 
middleware platforms among different VMs 
- Multi-tenancy 


Multi-tenancy 


eMulti-tenancy is where a single instance of the 
software runs on a server, serving multiple clients. 
- Think multiple users in a MySQL database 


- Java 9 should support multi-tenancy (many java programs 
running in the same JVM) 


eThe software should be able to provide a single 
service to all customers by setting configurations 
- More efficient use of server resources 


TaaS - what you get 
AMIs 


CentOS 


Windows 


Infrastructure -as -a- Service 


You might prefer this... 


YARN 


HDFS 


Configured stack of servers, dependencies, and firewalls and your app installed. 


A Platform-as-a-Service 
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Platform-as-a-Service (PaaS) 


ePlatform as a Service (PaaS) is a computing 
platform that abstracts the infrastructure, OS, and 
middleware to drive developer productivity. 


ePaaS leverages dynamic provisioning 


ePaaS leverages multi-tenancy 


Closed PaaS 


eA closed PaaS provides a fixed set of services you 
can use. You cannot install your own services. 


eThey are typically hosted at some IaaS provider. 


Closed PaaS Supported Langs/ Services 


Heroku Ruby, Node.js, JVM-langs, 
Python, SQL-DB, KV-Store 

AppFog PHP, Ruby, Node.js, Python, 
SQL-DB, KV-Store 

AppEngine (Google) Python, JVM-langs, GoLang 


AWS Beanstalk, RightScale,  .......... 
EngineYard, CloudBees, ... 


Open PaaS 


eAn open PaaS provides support for you to develop 
your own automated service deployments. 


CLOUD 
FOUNDRY 


Automated Installation: Chef/Puppet/Salt/Ansible 


Karamel/Chef 


eCluster definition in YAML 


eVirtualization using JClouds 
- Support for AWS/EC2, Google Cloud Platform, OpenStack 


eKaramelfile to Orchestrate Chef Recipes 
eChef-solo to execute recipes 


eStandalone thick-client application 
- Ability to store user credentials 
- Ability to use discover the user’s own ssh keys 


Karamel/Chef 


Karamel 


Validate 
Chef Cookbooks GitHub API 


JClouds API 


Create VMs 


GitHub 


Karamel installs Chef Recipes. 


Chef Cookbooks cloned from GitHub 
| Chef-Solo installs software — no agents. 


SSH SSH 


Case Study: Installing Hadoop 
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Cloudera Manager Cloud Express Wizard* 


Abridged EC2-specific installation instructions* 


Go to “EC2” in AWS web console and select “Instances” 
Use the default “М. Virginia (us-east-1)" region. 

Click on. “Launch Instance” 

On the next page, pick the "Ubuntu Server 12.04 LTS" 64-bit image. 
select "Create a new Key Pair." 

click "Create and Download your key pair." 

save this file or you won't be able to SSH into the instance we're 


about to launch. 


5 wget http://archive.cloudera.com/cm4/installer/latest/cloudera- 
manager-installer.bin 

5 chmod +x cloudera-manager-installer.bin 

$ sudo ./cloudera-manager-installer.bin 


*http://blog.cloudera.com/blog/2013/03/how-to-create-a-cdh-cluster-on-amazon-ec2 


-via-cloudera-manag rm 
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Karamel Cluster 


name: ApacheHadoop 
ec2: 
type: m3.medium 
region: eu-west-1 
cookbooks: 
hadoop: 
github: "hopshadoop/apache-hadoop-chef" 
version: "v0.1" 
groups: 
namenode: 
Size: 1 
recipes: 
- hadoop::namenode 
- hadoop::resourcemanager 
datanodes: 
Size: 2 
recipes: 
- hadoop::datanode 


- hadoop::nodemanager 


Definition 
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Karamel Hadoop Cluster - WebUI 


Configure 22 Cluster > ApacheHadoop 


hadoop::nn 


hadoop::dn 


x x 


hadoop:rm hadoop::nm 
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Other Cluster-Definition Driven PaaSes 


eAmazon Web Services OpsWorks 
- JSON cluster definition 
- Virtualization using EC2 
- Custom Orchestration 
- Chef-solo as provisioner 


eGoogle Kubernetes 
- JSON cluster definition 
- “Virtualization” using Docker Containers 
* Extended Linux Containers 
- Orchestration support for Docker Containers 
- No built in support for orchestration 


Software-as-a-Service (SaaS) 
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Software as a Service 


eSoftware as a Service - SaaS 
- Run applications on a provider's on a cloud infrastructure. 


- Applications are accessible from various client devices 
through a thin client interface such as a web browser. 


- User is oblivious to the underlying cloud infrastructure 


eExamples 
- Dropbox 
- Google Apps (e.g., Gmail, Google Docs, Google sites,..) 
- SalesForce.com 


Software as a Service 


Web-base Applications Web Portal 


Government 
Applications 


Scientific 
Applications 


Business 
Applications 


General 
Applications 


Application 


Obstacles To Cloud Computing 


eData Lock-in 

eData Confidentiality/Auditability 

eData transfer bottlenecks/costs 

ePerformance unpredictability for systems apps 


eLegislative Compliance Concerns in Europe 


Summary of Cloud Computing Architecture 


Visual Model Of NIST Working Definition Of Cloud Computing 
http://www.csrc.nist.gov/groups/SNS/cloud-computing/index.html 
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Conclusions 


eCloud computing has enabled an explosion in large- 
scale computing services and applications. 

eClouds provide services at three main levels: IaaS, 
PaaS, SaaS. 


eNew programming models enable easier 
development of large-scale applications. 


eHadoop is the open-source enabling technology for 
Big Data 


- Hadoop is rapidly becoming the operating system for the 
Data Center 
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